iOS 9.3 and Download Contacts to Car Address Book

After pairing my iPhone to my Dodge Durango, I used to use voice activation to place calls through the car speakers and microphone by saying "Call [contact name] Mobile (or home, or work)". I could call any number in my iPhone contacts list without much issue. Recently, I haven't successfully placed many calls via voice activation. Checking into it, I discovered that only the contact in my iPhone's Favorites list are being downloaded to to my car.

Is there a setting on my iPhone that that allows all contacts to be downloaded to the car when the phone pairs with the car instead of just my iPhone's favorites?